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SECRET ~ 

DCI/IC 1566-75 
6 February 1975 



MEMORANDUM FOR; 
SUBJECT 


Utilization of Review of National Intelligence 
Data for Management Purposes 


1. Detailed examination of PRD- generated data for 
tae prototype Review of National Intelligence (See Attach- 
ment A) indicates that this data is useful for linking 
IC current intelligence production to the KIQs. The review 
^ludcs PRD judgments on the "KIQ relationship” and 
the utility of each product. As a supplement to the KEP 
derived data on IC KIQ production, the PRD data would add 
a usefui dimension to analyzing the qualitative relation- 
between IC products and KIQs. An initial review by 
the R$A Branch of the prototype RONI was forwarded 19 
December (See Attachment B) . 


2. The following recommendations are based on our 
review of the PRD developed data: 

*.• Account for al l published articles. In 
November it was noted that o FT7 129 NT3J“lTl B and 
DIN articles published, 81 were not reviewed. 
Although the geographic/topic areas of the 81 
articles encompass substance not covered by the 
responsibilities of the NIOs, all the articles 
should be reviewed and/or accounted for, if only 
by count. This would raise the utility of RONI 
considerably, especially if it were to be used as 
an end of year aid to analyze community performance 
against KIQs. 


Accommodate double counting . Some of the 
articles were reviewed by more than one PRD analyst, 
possibly resulting in ’’double counting”. For 
example, of the total number of DIN articles reviewed 
(i.e., 273) there were reportedly 92 "double reviews”. 
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A methodology should be devised to account for 
those articles which cover bo re than one geographic/ 
topic area, or KIQ. 

c. Define terms used for d escribing "KIQ 
ts 1 at i on sh ip* " anlT p lroU'uc t "utility*' . ’Hore precise 
de fin it ion" of these terns would promote uniforn 
usage aaong analysts and would ensure greater under- 
standing by RON I recipients on the meaning of these 
terms, For each article an effort should be made 
to use only one descriptor for "KIQ relationship, 5 * 
and one for product ^utility". If the "KIQ Relation - 
ship ,r Is none, there should be no KIQ No, entry. If 
the reviewer believes that an article can be KIQ- 
related through additional analysis, a separate 
category should be created to indicate this possi- 
bility. 


d. Standardize "Sources" . The reviewers 
identified the ‘ sour ces^Trom the contents and 
classification of each article. One article nay 
have, of course, wore than one source that contri- 
butes information. The judgments of the reviewers 
regarding sources are probably as good as they can 
be, considering the broad categories of sources. 

A more detailed analysis of contributing sources 
would require consultation with the authors of the 
articles and might not be worth the time such 
consultations would require. Expansion to the IC 
©f CIA* a fhibllcation Source Survey (FsS) System 
T’wKTcfFre lies on the authors of the articles to 
provide collection source information) should be 
considered as a way of developing a more useful 
linkage between product and collection methods. 

e. Standardize geographic/ topic categories . 

Although the categories adhere generally to the 
geographlc/top lc respon sibilities of the HIOs and 
PRD analysts, I I and CIRIS geographic/topic 

categories should be used to provide a (more) 
uniform listing. 
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. , , , f • K ^aut lonajx. not e reg arding ’’Worklo ad" . 

A! though^]} currently reviewing" on ly 'tTfree 
intelilgence publications (i.e., NID, NIB, DIN), 
the intent is to expand the review process to 
include more IC products. As expansion occurs, 
collection and analysis of the raw data will 

5 i ,??: con ? u ? ing * In order to present 
and handle additional data in a meaningful way, 

the data should be routinely entered into a data 

statistical manipulation. 
a”?, 1 ? “ sl fJ PRD i" compiling periodic reports 
ana facilitate the use of the data (by MPRRD) for 
management purposes. Collection of the data for 
the three publications consumes about 501 of the 
reviewers time. Additional reviews will increase 

^i S !„Jf rC ? ntag \ c ?? slderabl y- Dail y review of 
products is probably not necessary for management 

purposes. One might review the above articles 
every other week, or even less frequently. Over 

hv P ili? d °J a yeaT * any peaks and val l«ys created 
by lack of coverage would, for practical purposes 
cancel out. * 


25Xh 


DCI/IC/MPRRD: 

Distribution: 

1 - Addressee , 
1 - IC Registry ^ 
1 - R§A Reading 
1 - RfjA Subject 
1 - DQ chrono 
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